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Dr.    Lee  S.    Dolson 

President,  Board  of  Education 

San  Francisco  Unified  School   District 

135  Van  Ness  Avenue 

San   Francisco,  California     94102 

Dear  Dr.    Dolson: 

As  you  know,  the  Commission's  general  mandate  was  to  consider  the 
disparity  between  the  dollars  spent  in  San  Francisco's  schools  and 
the  record  of  achievement  by  its  students.     This   report  focuses  on 
the  latter  concern,  providing  information  and  recommendations  on  the 
District's  testing  program. 

The  basic  problem  revealed  by  our  investigation  was   the    lack  of  a 
constructive  relationship  between  testing  and  instruction.     We 
found  that  test  results,  whether  initiated  at  the  state  or  district 
level,  were   rarely  analyzed  and  used  to  improve  the  quality  of  in- 
struction.     Further,   the  administration  of  the  testing  program  is 
not  coordinated,  making  more  difficult  efforts  to  use  their  results. 
Among  other  corrective   actions,  both  state  and  local   assessment 
programs   should  be   reviewed  with  greater  input   from  lay  citizens 
and  professionals. 

We  have  been  pleased  to  note  the  preliminary  response  of  the  Super- 
intendent and  his  staff  to  our  analysis.     A  Cabinet-level   committee 
has   recently  been   appointed  to  consider  a  number  of  our  administrative 
recommendations.     To   further  the  process  of  improving  both  standard- 
ized and  individual   testing  activities,  the  Commission  urges  the 
School   Board  to  adopt  the   full    range  of  recommendations   as   District 
policy  and  to  direct  effective  steps  toward  implementation. 


Sincerely,      S — \ 

William  M.   Roth 
Chai  rman 
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BACKGROUND 

The  purpose  of  this  report  is  to  provide  information  on  testing  and  test  use  in 
the  San  Francisco  Unified  School  District.  Throughout  the  analysis,  actual 
or  potential  problem  areas  are  identified,  and  suggestions  are  offered  to 
correct  these  problems. 

The  testing  activities  examined  exclude  tests  developed  by  teachers  for 
determining  student  achievement,  as  well  as  tests  used  to  determine  health 
status  (e.g.,  visual  tests,  hearing  tests,  etc.).  Attention  is  directed  toward 
those  tests  that  are  developed  outside  the  school  system  and  used  (often 
required)  for  assesment  of  student  ability  or  achievement.  These  myriad 
testing  activities  take  place  in  a  number  of  departments  and  serve  several 
different  purposes. 

Some  of  the  tests  are  tied  directly  to  instructional  objectives,  but  others 
are  only  indirectly  related  to  such  objectives.  With  respect  to  the  latter, 
participation  in  the  statewide  California  Assessment  Program,  which  is 
required  by  law,  provides  data  on  the  achievement  of  San  Francisco  students 
in  grades  2,  3,  6,  and  12,  as  compared  with  other  California  school  districts. 
Little  information  leading  to  instructional  improvement  is  provided, 
although  any  data  which  point  to  areas  of  low  performance,  as  compared 
with  other  districts,  has  some  value.  On  the  other  hand,  testing  undertaken 
in  the  Compensatory  Education  Program,  while  also  used  for  evaluation 
purposes,  provided  information  which  has  potential  use  in  instructional 
planning. 


ORGANIZATION  OF  TESTING  ACTIVITIES 

The  organization  of  the  District  is  undergoing  some  change.  However,  the 
most  recent  organizational  chart  placed  most  of  the  District's  testing 
activities  (e.g.,  California  Assessment  Program  testing,  and  the  District's 
own  program  of  diagnostic  and  achievement  testing)  within  the  Division  of 
Research.  Testing  in  connection  with  various  state  and  federally  funded  pro- 
grams is  handled  separately.  Nevertheless,  there  is  evidence,  both  presently 
and  in  the  past,  that  the  Division  of  Research  staff  have  worked 
cooperatively  with  the  staffs  of  these  funded  programs  in  test  selection  and 
scheduling. 


Ideally,  there  should  be  some  integration  of  test  data  obtained  for 
instructional  and  evaluative  purposes.  In  many  cases,  test  scores  developed 
for  one  purpose  can  serve  another.  Implementation  of  such-  a  scheme 
requires  (1)  a  staff  of  sufficient  size  to  manage  the  myriad  testing  activities 
associated  with  assorted  projects,  and  (2)  an  organizational  structure  which 
encompasses  producers  of  tests,  consumers  of  test  information,  and  policy- 
makers. Such  a  structure  does  not  appear  to  be  functioning  in  the  District.  It 
is  recommended,  therefore,  that  a  Testing  Council  should  be  formed.  Such  a 
council  might  be  headed  by  the  Deputy  Superintendent  for  Instruction,  and 
include  among  its  members  the  various  divisional  assistant  superintendents, 
the  Director  of  the  Division  of  Research,  and  the  directors  of  various  state 
and  federal  programs. 

The  Testing  Council  should  report  directly  to  the  Superintendent.  It  would 
have  as  its  major  charge  the  development  of  objectives  for  the  testing  pro- 
gram; the  assessment  of  the  testing-evaluation  requirements  for  federal, 
state,  and  district  programs,  with  particular  attention  to  their  integration 
with  the  District's  instructional  program;  and  coordination  of  the  develop- 
ment of  proficiency  standards  in  the  light  of  the  recent  Board  resolution 
requiring  minimum  subject  matter  proficiency  at  certain  grade  levels. 
Similar  centralized  organizational  plans  are  operational  within  the  Los 
Angeles  Unified  School  District,  as  well  as  in  San  Diego  and  Oakland.  These 
structures  are  not  only  more  parsimonious,  but  they  also  enhance  the 
possibility  of  the  integration  of  testing  activities  and  instructional  objectives. 

There  is  also  the  need  to  ensure  that  input  from  teachers  is  adequately 
represented  in  decisions  about  test  selection  and  use.  Consequently,  it  is 
recommended  that  the  teacher-administrator  District  Advisory  Committee 
on  the  Standardized  Testing  Program  should  be  reactivated.  This  com- 
mittee, composed  of  teachers  and  administrators,  was  established  in  March 
1974  as  part  of  the  negotiated  agreement  between  the  Board  of  Education  and 
the  Certificated  Employees  Council.  It  met  a  number  of  times  during 
1974-75,  and  among  its  important  accomplishments  were:  (1)  a  useful  teacher 
questionnaire  on  standardized  testing,  developed  and  administered  under 
committee  auspices  and  completed  by  elementary  and  junior  high  school 
teachers;  (2)  critical  analyses  of  problems  which  the  District's  testing  pro- 
gram faces;  and  (3)  a  number  of  suggestions  for  policies  on  standardized  test 
selection  and  review.  If  the  1975-76  memorandum  of  understanding  had  not 
discontinued  the  Advisory  Committee,  it  is  likely  that  useful  changes  in  the 
testing  program  could  have  been  effected. 


PURPOSES  OF  TESTING 

In  the  San  Francisco  schools,  tests  are  administered  for  the  following  pur- 
poses: 

1.  To  evaluate  student  achievement  for  comparison  with  students  in  other 
California  school  districts  (California  Assessment  Program); 

2.  To  evaluate  pupils  enrolled  in  state  and  federally  funded  projects  (Title 
I  ESEA,  SB-90,  etc.); 

3.  For  instructional  assessment  and  placement  within  regular  classrooms; 
and 

4.  To  provide  evaluation  for  placement  in  special  classes  (classes  for  the 
mentally  retarded,  the  educationally  handicapped,  and  the  mentally 
gifted). 

Information  on  testing  programs,  testing  purposes,  and  test  result  users  is 
summarized  in  Table  1. 

The  diversity  of  uses  to  which  test  results  are  put  highlights  the  fact  that  there 
is  no  overarching  "District  statement"  on  such  matters.  Without  gainsaying 
the  fact  that  tests  have  some  value  in  guidance  and  administration,  a 
statement  of  philosophy  should  be  developed  to  emphasize  the  importance 
of  measuring  the  effectiveness  of  instruction,  as  well  as  providing  a  sound 
basis  for  instructional  planning  for  individual  pupils.  Most  testing  activities 
then  should  be  interpreted  in  the  light  of  their  relationship  to  instruction.  The 
adoption  of  such  a  framework  would  suggest  that  responsibility  for  formal 
testing  in  the  District  should  reside  in  the  Office  of  the  Deputy  Superinten- 
dent for  Instruction. 


THE  DISTRICT'S  TESTING  ACTIVITIES 


In  the  following  sections  is  provided  a  description  and  critique  of  various 
testing  activities  in  the  District.  Where  appropriate,  attention  is  drawn  to 
areas  in  which  changes  in  programs  and  practices  might  be  made,  and  to 
areas  where  specific  recommendations  can  be  offered. 


TABLE  1 


Testing  Programs,  Testing  Purposes,  and  Test  Users 


Testing  Program/Tests        Purposes 


Who  Uses 


1.  California  Assessment 
Program  (Tests  of 
Achievement  in  read- 
ing, spelling,  mathema- 
tics, etc.  in  grades  1-3, 
6,  12) 


Federal-State  (various 
achievement  tests) 


District  (Achievement 
and  diagnostic  tests) 


4.  Pupil  Services  (Individ- 
ual psychological  and 
educational  tests) 


Met  statutory  re- 
quirements; 

Facilitate  decision- 
making for  allocation  of 
of  funds  to  districts; 

Local  school  district 
and  school  building 
evaluations 

Meet  statutory  require- 
ments of  pre-post 
achievement  testing; 
Individual  program 
planning 

To  assess  student 
achievement; 
Diagnose  student 
strengths  and  weaknes- 
ses for  instructional 
planning; 

Meet  Board  require- 
ments (math) 

To  meet  statutory  re- 
quirements for  placing 
certain  children  in  spe- 
cial classes  and  pro- 
grams; 

Development  of  educa- 
tional plans  for  individ- 
ual pupils 


State  Dept.  of  Ed.  offic- 
ials 


State  Dept.  of  Ed.  offic- 
ials 


District  Administrators 
&  teachers 

State  Dept.  of  Ed.  offi- 
cials; Program  Evalua- 
tors 

Teachers 

Teachers,  Administra- 
tors 


Teachers 
Administrators  & 
Teachers 

State  level  and  District 
Administrators 


Classroom  teachers 


CALIFORNIA  ASSESSMENT  PROGRAM 

The  California  Assessment  Program  (CAP)  is  a  series  of  tests  administered 
in  California  school  districts.  Its  purposes  are  twofold:  (1)  to  inform  the 
public  about  how  well  California  school  children  are  learning  basic  skills;  and 
(2)  to  facilitate  decision-making,  at  the  state  level,  for  allocation  of  funds  to 
special  programs.  All  California  school  districts  are  required  by  law  to 
participate. 

The  tests  are  conceptualized  by  State  Department  of  Education  officials  and 
representatives  of  various  California  school  districts.  They  are  administered 
to  all  pupils  enrolled  in  grades  1,  2,  3,  6,  and  12;  they  consist  of  the 
assessment  of  entry  level  reading  skills  (grade  1),  reading  skills  (grades  2,  3, 
6,  and  12),  and  achievement  in  written  expression,  spelling  and  mathe- 
matics (grades  6  and  12).  A  list  of  the  content  areas  and  a  description  of  skills 
tested  at  the  various  grade  levels  is  presented  in  Table  2. 

The  CAP  tests  are  administered  by  SFUSD  personnel  and  scored  by  the 
State  Department  of  Education.  There  is  no  direct  cost  to  the  District, 
although  there  are  indirect  costs,  e.g.,  teacher  time  in  test  handling,  and  the 
time  required  to  complete  the  tests  (35  minutes  at  grades  2,  3,  and  6).  The 
tests  are  completed  anonymously  by  students  and  the  results  are  reported 
back  to  the  District  by  school  building.  A  total  District  ranking,  which  pro- 
vides information  on  how  students  in  San  Francisco  schools  compare  with 
students  in  other  California  school  districts,  is  also  given. 

An  important  need  is  to  develop  measures  which  reflect  the  quality  of 
education  which  students  are  receiving  in  the  schools.  There  are  many 
possible  indexes  by  which  the  effectiveness  of  an  educational  system  might 
be  measured.*  Without  minimizing  the  importance  of  any  measures  that 
might  be  developed,  scores  on  tests  of  achievement  in  important  skill  areas 
will  probably  always  be  a  key  index  of  the  effectiveness  of  the  educational 
system.  Unless  there  are  legislative  enactments  which  change  current  policy 
and  practice,  California  Assessment  Program  tests  are  likely  to  be  used  as  a 
measure  of  SFUSD  effectiveness  for  sometime  into  the  future.  Thus,  the 
CAP  tests  need  to  be  examined  carefully  for  their  value  as  indexes  of  student 
achievement. 


*  A  number  of  such  measures  are  being  developed  by  the  Commission  and  will  be  the 
subject  of  a  subsequent  report  on  a  "school  evaluation  profile". 


TABLE  2 


California  Assessment  Program:  Test  Content  and  Format 


Name  of  Test  and    No.  of  No.  of 
Grade      Content  Areas       Items    Forms 


Skills  Tested 


1    Entry  Level  Test      35 


1  Immediate  recall,  letter  recognition,  auditory 
discrimination,  visual  discrimination,  language 
development 


2    Reading  Test         250 


250 


10  Word  identification  -  phonetic  analysis;  vocab- 
ulary; comprehension  -  literal  and  interpretive; 
study  -  locational 


6    Survey  of  Basic 

Skills:  Grade  6       434 


Reading 


98 


Written  112 
Expression 

Spelling  56 

Mathematics  168 


14 


Word  identification;  vocabulary;  comprehen- 
sion -  literal,  interpretive,  critical;  study  -  loca- 
tional 

Sentences  -  recognition  and  manipulation, 
punctuation  and  capitalization;  word  forms; 
language  choices 

Recognition  of  misspelled  word  in  a  set  of 
words. 

Arithemetic  -  number  concepts,  whole  num- 
bers, fractions,  decimals;  geometry;  measure- 
ment and  graphs;  probability  and  statistics. 


12     Survey  of  Basic     478 
Skills:  Grade  12 


Reading 

Written 
Expression 


144 


82 


Spelling  54 

Mathematics       198 


18 


Vocabulary;  comprehension  -  literal,  interpre- 
tive, critical;  study  -  locational. 

Sentences  -  recognition  and  manipulation,  cap- 
italization and  punctuation;  paragraphs,  word 
parts;  language  choices. 

Recognition  in  context  of  a  misspelled  word. 

Arithmetic  -  number  concepts,  whole  num- 
bers, fractions,  decimals;  geometry;  measure- 
ment and  graphs;  probability  and  statistics. 


Limitations 

For  several  reasons,  the  CAP  results  are  not  likely  to  provide  the  kind  of 
information  which  will  be  useful  to  the  District  in  monitoring  the  effective- 
ness of  instructional  or  administrative  changes. 

(1)  The  CAP  tests  are  not  administered  at  all  grades  and  in  all  subject  areas. 
A  comprehensive  picture  of  student  achievement  at  all  grade  levels, 
therefore,  is  not  presented. 

(2)  SFUSD  achievement  is  always  communicated  in  relationship  to  the 
performance  of  other  school  districts  within  the  State  of  California. 
Under  the  percentile  rank  system,  one-half  of  the  school  districts  in  the 
state  will  always  be  below  average. 

(3)  Even  for  the  tests  which  are  available,  the  composition  of  items  changes 
from  year  to  year,  and  there  are  probably  subtle  changes  as  well  in  areas 
covered,  thus  giving  no  real  continuity  in  what  is  measured. 

(4)  The  meaning  of  any  changes  in  achievement  levels  of  San  Francisco 
pupils  will  be  difficult  to  interpret.  For  example,  if  the  achievement 
level  of  all  schools  in  the  state  move  up  at  the  same  rate,  then  San 
Francisco's  percentile  ranking  would  not  change.  On  the  other  hand,  an 
increase  in  achievement  in  San  Francisco  may  merely  reflect  the  fact 
that  other  districts  have,  for  whatever  reason,  declined. 

While  recognizing  the  value  of  information  on  how  students  in  the  San 
Francisco  schools  compare  with  others  in  the  state,  there  is  concern  that 
these  results  do  not  have  immediate  value  in  instructional  assessment  and  in 
instructional  planning.  It  is  recommended,  therefore,  that  State  Department 
of  Education  officials  be  requested  to  provide  assistance  in  the  development 
and/or  identification  of  assessment  instruments  which  are  more  directly 
relevant  to  school  system  needs  in  the  areas  of  instructional  assessment 
and  planning.  Assistance  should  also  be  provided  in  the  development  andlor 
identification  of  measures  of  attitude,  motivation,  self-esteem  and  other 
variables  related  to  school  performance  or  which  represent  instructional 
objectives. 

Although  there  are  several  means  by  which  these  objectives  might  be 
accomplished,  one  potentially  useful  activity  would  be  for  the  State  Depart- 
ment of  Education,  Division  of  Research  Personnel,  to  develop  a  repository 
of  test  items  developed  for  use  at  all  grade  levels,  in  various  subject  areas, 
and  reflecting  diverse  objectives  and  learning  outcomes.  School  districts 


could  draw  from  this  information  to  develop  test  batteries  tailored  to  their 
unique  local  situation.  Other  possibilities  include  the  development  of  lists  of 
tests  that  might  be  used  for  assessment  purposes,  and  workshops  on  test 
development  and  selection  for  personnel  in  individual  school  districts. 

The  California  Assessment  Program  has  been  singled  out  for  attention  be- 
cause data  from  it  are  likely  to  continue  to  be  the  yardstick  by  which  the 
effectiveness  of  the  San  Francisco  schools  is  measured.  The  limitations  of 
these  tests  must  therefore  be  recognized  and  alternative  measures  of  school 
effectiveness  must  be  sought.  With  respect  to  tests,  viable  additions  to  the 
testing  program  include  achievement  tests  that  provide  information  on 
absolute  rather  than  relative  performance.  Here  the  concern  is  with  the 
actual  skills  possessed  by  students  at  various  grade  levels,  as  contrasted 
with  how  one  group  of  students  compares  with  another.  A  related  need  is 
to  include  tests  which  measure  objectives  other  than  achievement.  Testing 
and  assessment  should  be  expanded  to  include  such  areas  as  attitudes 
toward  school,  schooling,  and  school  personnel,  self-esteem,  etc.  It  is 
recommended,  therefore,  that  the  testing  activities  of  the  District  should  be 
expanded  to  include  assessment  of  school  attitudes  and  other  related 
attributes. 

Even  though  the  CAP  results  are  reported  in  local  newspapers,  they 
probably  are  communicated  in  a  way  which  has  little  meaning  to  the  average 
citizen.  Nevertheless,  the  central  message  is  reasonably  clear  with  respect  to 
achievement:  compared  to  other  school  districts  in  the  state,  students  in 
the  San  Francisco  schools  fare  poorly.  It  is  recommended,  therefore,  that 
the  District  should  be  encouraged  to  secure,  at  appropriate  grade  levels, 
information  about  pupil  accomplishment  of  important  minimum  skills 
necessary  for  effective  living,  e.g.,  completing  a  job  application  form, 
balancing  a  checkbook,  planning  a  balanced  meal,  computing  the  interest  on 
a  loan,  etc.  Periodic  reports  in  these  areas,  in  a  language  which  lay  persons 
understand,  can  serve  as  a  kind  of  report  card,  to  the  community,  of  certain 
pupil  accomplishments. 


TESTING  IN  FUNDED  PROGRAMS 

Many  District  programs  receiving  state  or  federal  funds  are  required  to 
evaluate  their  programs  by  administering  standardized  tests  in  reading, 
language,  and  arithmetic.  These  tests  are  conducted  either  at  the  beginning 
and/or  at  the  end  of  each  school  year.  Thus,  all  schools  receiving  funds  from 


Title  I/SB  90,  Early  Childhood  Education,  certain  bilingual  programs,  and 
others,  must  provide  data  on  student  achievement. 

During  the  present  school  year,  the  scheduling  of  testing  in  funded  programs 
has  been  undertaken  cooperatively  with  the  Division  of  Research.  More- 
over, in  grades  1-7  at  least,  the  tests  are  being  administered  to  all  children,  not 
just  those  in  compensatory  education  (see  Table  3).  There  is,  however,  no 
evidence  to  indicate  that  test  selection  has  involved  personnel  in  the  Division 
of  Research,  the  Reading  Office,  the  Associate  Superintendent  for 
Instruction,  and  other  individuals  and  groups  who  need  to  be  involved  in  the 
test  selection  process.  While  the  cooperation  between  the  funded  programs 
and  the  Division  of  Research  is  to  be  applauded,  the  formation  of  a  Testing 
Council,  the  reactivation  of  the  teacher-administrator  advisory  committee  on 
the  standardized  testing  program,  and  the  vesting  of  all  testing  decisions  in  a 
single  unit  would  go  further  to  ensure  the  kind  of  coordination  necessary  for 
integrating  testing  with  instructional  objectives,  needs,  and  priorities  at  the 
District  level,  as  well  as  meeting  the  evaluation  requirements  of  various 
funding  agencies. 

Among  the  noteworthy  activities  concerning  test  use  in  the  Title  I/SB  90 
programs  are  a  series  of  orientation  meetings  on  testing  for  parents, 
orientation  sessions  for  teachers,  an  attempt  to  match  test  items  to 
instructional  objectives,  and  the  provision  of  a  detailed  description  of  student 
test  performance  through  the  Comprehensive  Test  of  Basic  Skills,  which  is 
completed  by  all  students.  Such  a  program  of  activity  might  well  be 
implemented  in  other  District  testing  programs. 


TESTING  FOR  INSTRUCTIONAL 
ASSESSMENT  AND  PLACEMENT 

Most  of  the  organized  testing  is  coordinated  by  the  Division  of  Research. 
California  Assessment  Program  activities  are  coordinated  by  this  division, 
which  prepares  a  calendar  of  testing  activities  and  dates.  Further,  division 
personnel  provide  consultation  to  teachers  and  principals  on  the  selection  of 
tests  for  use  in  instructional  planning  and  assessment.  They  also  provide  test 
scoring  and  assistance  in  the  interpretation  of  test  results.  A  calendar  of 
District  tests  administered  during  1975-76  is  presented  in  Table  4. 


10 


TABLE  3 


Title  I  Evaluation  Testing  Program:  1976 


Tctt 
Data 

Grade 

Students  to 
Be  Tested 

Teit  end  Sections 
To  Be  Given 

Approx.  Time 
Required 

Apr.  19 

thru 
Apr.  30 

1 

ALL 

Comprehensive  tests  of  basic  skills, 
Form  S.  Level  B:  Reading, 
Language,  Math 

234  min. 

Apr.  19 

thru 
Apr.  30 

2 

ALL 

Comprehensive  tests  of  basic  skills, 
Form  S.  Level  C:  Reading, 
Language,  Math 

255  min. 

Apr.  19 

thru 
Apr.  30 

3 

ALL 

Comprehensive  tests  of  basic  skills, 
Form  S,  Level  1:  Reading, 
Language,  Math 

248  min. 

Apr.  19 

thru 
Apr.  30 

4 

ALL 

Comprehensive  tests  of  basic  skills, 
Form  S,  Level  1:  Reading, 
Language,  Math 

248  min. 

Apr.  19 

thru 
Apr.  30 

5 

ALL 

Comprehensive  tests  of  basic  skills, 
Form  S,  Level  2:  Reading, 
Language,  Math 

254  min. 

Apr.  19 

thru 
Apr.  30 

6 

ALL 

Comprehensive  tests  of  basic  skills, 
Form  S,  Level  2:  Reading, 
Language,  Math 

Apr.  19 

thru 
Apr.  30 

7 

ALL 

Comprehensive  tests  of  basic  skills 
Form  S,  Level  3:  Reading, 
Language,  Math 

237  min. 

Apr.  19 

thru 
Apr.  30 

8 

SB  90 
Partici- 
pants 

Comprehensive  tests  of  basic  skills, 
Form  S,  Level  3:  Reading, 
Language,  Math 

237  min. 

The  testing  program  has  been  in  a  state  of  flux  during  the  past  three  years, 
with  tests  being  used  varying  from  one  year  to  the  next.  If  the  tests  are  to  have 
any  value  in  providing  information  about  changes  in  the  achievement  level  of 
individual  students,  school  sites,  or  the  District  as  a  whole  from  one  year  to 
the  next,  the  tests  used  must  become  stabilized.  The  Comprehensive  Test  of 
Basic  Skills  (CTBS),  for  example,  being  administered  this  year  to  all  students 
in  grades  1-7,  is  a  rather  popular  instrument  for  the  assessment  of  school 
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TABLE  4 


District  Testing  Program  1975-76 


Month 

Grade 

Test  and  Test  Sections 

April 

1 

Comprehensive  Test  of  Basic  Skills,  Form  S,  Level 
B:  Reading,  Language,  Math 

April 

2 

Comprehensive  Test  of  Basic  Skills,  Form  S,  Level 
E:  Reading,  Language,  Math 

April 

3 

Comprehensive  Test  of  Basic  Skills,  FormS,  Level 
1:  Reading,  Language,  Math 

April 

4 

Comprehensive  Test  of  Basic  Skills,  Form  S,  Level 
1:  Reading,  Language,  Math 

April 

5 

Comprehensive  Test  of  Basic  Skills,  Form  S,  Level 
2:  Reading,  Language,  Math 

April 

6 

Comprehensive  Test  of  Basic  Skills,  Form  S,  Level 
2:  Reading,  Language,  Math 

April 

7 

Comprehensive  Test  of  Basic  Skills,  Form  S,  Level 
3:  Reading,  Language,  Math 

October 

10 

Comprehensive  Test  of  Basic  Skills,  Form  Q,  Level 
3  or  4,  Reading  required 

October 

11 

Stanford  Achievement  Test,  Advanced,  Form  W 
(Arithmetic:  Computation,  Concepts,  Applications 
required).  (Reading:  Paragraph  meaning  optional) 

achievement.  The  tests  provide  a  description  of  student  performance  in  the 
areas  of  reading,  language,  and  mathematics.  Illustrations  of  areas  covered 
in  Form  S,  Level  B,  a  test  for  first  graders,  is  presented  in  Table  5. 


Information  about  student  performance  on  each  CTBS  test  item  is  pre- 
sented. While  measurement  specialists  have  criticized  the  subtests  (i.e., 
phonemes,  word  recognition,  etc.)  for  containing  too  few  items  to  consti- 
tute reliable  measures  of  the  area  being  tested,  the  individual  profiles  do 
provide  concrete  information  about  what  students  can  and  cannot  do.  This 
is,  potentially,  very  useful  information.  However,  the  tests'  value  in 
instructional  planning  in  San  Francisco  schools  is  very  much  minimized,  if 
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TABLE  5 


CONTENT  CATEGORIES  FOR  LEVEL  B 
BY  TEST  TITLE 


LETTER  SOUNDS 

Phonemes  -  Identify  the  letter(s)  that  makes  a  particular  sound  in  a  word  read 
aloud.  Sounds  tested  are  final  consonants,  medial  vowels,  and  beginning  consonant 
digraphs  and  blends. 

WORD  RECOGNITION  I 

Word  Recognition  -  Identify  the  written  presentation  of  a  word  read  aloud. 

READING  COMPREHENSION 

Sentence  Meaning  -  Demonstrate  understanding  of  sentences  by  selecting,  from 
three  pictures,  the  one  that  is  a  representation  of  the  content  of  the  sentence. 

WORD  RECOGNITION  H 

Word  Recognition  -  Identify  the  written  word  that  defines  a  picture. 

LANGUAGE  I 

Structure/Syntax  -  Identify  correct  use  of  plurals,  verbs,  and  comparative  adjec- 
tives. Understand  different  sentence  patterns. 

LANGUAGE  II 

Formation/Syntax  -  Judge  whether  or  not  a  sentence  is  syntactically  correct. 
Identify  correct  formation  and  use  of  plurals,  verbs  (tense,  participles,  number), 
comparative  adjectives  and  possessive  pronouns. 

MATHEMATICS  CONCEPTS  AND  APPLICATIONS 

Number  Systems  -  Understand  concepts,  and  identify  examples,  of  comparison 
and  ordinal  numbers.  Convert  from  one  mathematical  form  to  another.  Solve  simple 
problems  involving  number  sentences. 

Measurement  -  Tell  time,  identify  amounts  of  money,  solve  simple  problems 
involving  money,  identify  an  inch. 

Basic  Operations  -  Solve  simple  word  problems  by  addition  or  subtraction; 
Arabic  numerals  and  pictures  are  used. 

MATHEMATICS  COMPUTATION 

Operations  -  Solve  one-  and  two-digit  addition  and  subtraction  problems  (without 
regrouping)  in  horizontal  and  vertical  formats. 


not  eliminated  altogether,  by  the  fact  of  their  being  administered  in  April 
when  the  school  year  is  almost  over.  Early  consideration  by  the  Testing 
Council  should  be  given  to  changing  the  timing  of  these  tests. 
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Tests  administered  to  all  students  enrolled  in  grades  10  and  11,  also  part  of 
the  District's  testing  program,  focus  primarily  upon  reading  and  mathemati- 
cal skills.  While  data  on  student  performance  on  these  tests  are  reported  back 
to  the  school  site,  they  do  not  appear  to  be  used  systematically  in  instruc- 
tional planning  and/or  assessment.  Indeed,  their  major  purpose  is  to  provide 
the  basis  for  ranking  schools  according  to  achievement  so  as  to  determine 
eligibility  for  receiving  Title  I  funds. 

In  addition  to  tests  referred  to  in  Table  4,  the  following  additional  tests  are 
administered  on  requests  of  classroom  teachers  and  site  administrators: 
Metropolitan  Readiness  Tests,  Stanford  Diagnostic  Reading  and  Mathe- 
matics Tests,  the  Survey  of  Algebraic  Aptitude,  the  Gilmore  Oral  Reading 
Test,  the  Durrell  Analyses  of  Reading  Difficulty,  the  Gates-MacGinitie 
Reading  Test,  and  the  Stanford  Reading  Test.  These  are  mostly  diagnostic 
tests  and  are  probably  used  by  teachers  to  make  assessments  of  pupil  areas 
of  strengths  and  weaknesses  for  purposes  of  instructional  planning. 

The  most  glaring  weakness  in  the  District's  testing  program  is  the  apparent 
failure  of  teachers  and  site  administrators  to  use  test  results  systematically  in 
instructional  assessment  and  planning.  Here  again,  the  Testing  Council 
should  explore  this  lack  of  coincidence  of  interest  as  an  early  undertaking. 


Controversy  over  Achievement  Testing 

The  utilization  of  tests  to  evaluate  a  Title  I  program  was  actively  resisted  by 
a  group  of  teachers  in  one  elementary  school  who  refused  to  administer  the 
tests  to  their  pupils  on  the  grounds  that  the  tests  were  ineffective  as 
measures  of  student  achievement.  An  extended  meeting  with  the  teachers 
revealed  concern  about  test  appropriateness  in  the  light  of  objectives  held  for 
the  pupils.  There  was  no  objection  to  evaluation,  and  the  teachers  expressed 
a  need  for  assistance  in  developing  alternative  assessment  tools,  but  they  felt 
that  no  such  assistance  was  available  in  the  District.  While  this  is  something 
of  an  overstatement,  it  is  not  far  from  the  actual  state  of  affairs.  District 
personnel  have  not  been  ordinarily  available  to  provide  the  kind  of  assistance 
which  some  teachers  feel  necessary. 

If  adequate  services  are  to  be  provided  teachers  and  administrators  in  the 
area  of  test  use  and  evaluation,  it  is  recommended  that  the  role  of  the 
Division  of  Research  should  be  expanded  to  centralize  all  group  testing  and 
assessment  activities.  The  Division  must  then  be  provided  with  sufficient 
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personnel  resources  to  assist  in  test  selection,  test  construction,  and  test 
evaluation.  Once  centralized,  such  an  office  will  be  able  to  address  the  con- 
cerns which  lead  to  its  creation  only  if  it  is  adequately  staffed  with  personnel 
having  the  training  congruent  with  the  current  needs  of  the  District. 
Observations  supporting  this  recommendation  are  as  follows: 

(1)  Teacher  dissatisfaction  with  certain  testing  practices,  along  with  their 
expressed  need  for  assistance  in  developing  more  suitable  instruments; 

(2)  The  need,  expressed  particularly  by  those  involved  in  the  administra- 
tion of  a  variety  of  special  projects,  but  also  by  some  school  administra- 
tors and  teachers,  to  have  measures  in  such  areas  as  pupil  self-esteem, 
school  attitudes,  and  other  factors  thought  to  be  related  to  school 
achievement  and/or  which  themselves  represent  valuable  educational 
outcomes; 

(3)  The  disproportionately  large  numbers  of  students  in  the  San  Francisco 
schools  who  are  limited  English  speakers,  dictating  that  assessment 
instruments  be  constructed  in  the  students'  native  language; 

(4)  The  need  for  an  ongoing  program  to  develop  tests  and  measurements 
which  are  more  suitable  for  the  multi-class,  multi-racial  school 
system;  and 

(5)  The  need  to  develop  assessment  procedures  which  are  alternative  to  the 
banned  IQ  tests  (see  sections  on  The  Testing  of  Minority  Group 
Children). 

In  addition  to  providing  assistance  in  the  development  and  evaluation  of 
assessment  instruments,  such  personnel  might  be  expected  to  provide 
leadership  in  several  areas  related  to  testing  which  presently  receive  little 
attention,  e.g.,  preparation  of  students  for  test  taking  and  the  preparation 
of  teachers  for  test  administration  and  test  interpretation. 

It  has  been  suggested  that  funds  for  specialists  in  test  construction  and 
evaluation  could  be  obtained  by  reducing  the  District's  testing  program. 
However,  while  tests  presently  used  in  the  District's  testing  program  appear 
to  be  only  minimally  used  in  instruction,  they  are  nevertheless  required  for 
certain  purposes.  In  the  mathematics  area,  for  example,  the  tests  are 
required  by  the  District  for  the  assessment  of  student  achievement  of  a 
minimal  level  of  mathematics  proficiency  in  grade  11.  The  Comprehensive 
Tests  of  Basic  Skills  are  required  to  establish  achievement  levels  of 
individual  schools  in  connection  with  Compensatory  Education  funding 
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requirements.  Even  with  judicious  pruning  of  the  existing  program,  it  is 
unlikely  that  more  than  two  to  three  thousand  dollars  would  be  saved. 


Testing  For  Special  Class  Placement 

Having  considered  the  administration  of  group  tests,  attention  is  now  drawn 
to  individual  tests  and  related  problems.  Individual  tests  are  those  developed 
to  be  administered  to  one  pupil  at  a  time.  Such  tests  (usually  IQ  tests  and 
tests  of  social  and  motor  functioning)  are  administered  by  a  state  certified 
psychologist  for  purposes  of  identifying  children  for  placement  in  special 
classes  and  programs.  Presently,  testing  and  other  school  psychological 
services  are  mandated  for  the  following  groups  of  students:  mentally  handi- 
capped minors,  educationally  handicapped  pupils,  aphasic  and/or  other 
severe  oral  language  handicapped,  mentally  gifted  minors,  the  develop- 
mentally  disabled,  minors  with  behavior  disorders,  the  hearing  handicapped, 
the  visually  handicapped,  the  pre-school  severely  handicapped,  and  the 
autistic  program. 

In  addition  to  providing  information  about  intelligence  level,  the  psycholo- 
gical tests  are  often  used  in  developing  an  individual  instructional  plan  for 
students  who  have  been  assigned  to  the  special  classes  or  programs.  Most 
special  programs,  particularly  those  for  handicapped  children,  enroll  fewer 
students  and  require  specially  trained  teachers.  Presumably,  these  two  facts, 
combined  with  the  secialized  assistance  in  diagnosis  and  educational 
prescription  provided  by  psychologists,  lead  to  an  appropriate  educational 
program  for  the  handicapped  student. 

The  involvement  of  school  psychologists  in  testing  for  special  class  place- 
ment, and  in  providing  consultation  to  teachers  and  pupils  about  mental 
health  and  instructional  problems,  is  quite  extensive;  SFUSD  psychologists 
estimate  that  their  activities,  in  one  way  or  another,  affect  some  ten  percent 
of  the  District's  student  population.  There  are  two  such  testing  issues  which 
require  resolution:  the  testing  of  children  from  non-English  speaking  back- 
grounds, and  the  testing  of  minority  group  children. 


SPECIAL  TESTING  PROBLEMS 

The  administration  of  IQ  tests,  especially  to  minority  group  children  for 
purposes  of  placement  in  special  classes  for  the  mentally  handicapped, 
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is  controversial.  Similarly,  there  is  the  concern  about  the  use  of  IQ  and  other 
tests  with  children  from  non-English  speaking  backgrounds.  In  view  of  the 
special  problems  in  test  use  with  non-English  speaking  and  minority  students 
that  exist,  it  is  important  to  explore  the  adjustments  which  San  Francisco  is 
making  in  modifying  tests  and  testing  for  these  special  populations. 

Problems  of  Language 

San  Francisco  is  polyglot,  perhaps  more  so  than  any  school  district  in  the 
State  of  California.  As  data  in  Table  6  show,  in  1974,  79%  of  California  public 
school  children  spoke  only  English,  as  compared  with  65%  of  students  in 
San  Francisco  schools.  Moreover,  while  7%  of  students  in  the  state  spoke 
limited  English  (along  with  a  second  language),  14%  of  students  enrolled  in 
San  Francisco  schools  were  limited  English  speakers. 

The  diversity  of  language  backgrounds  of  SFUSD  pupils  has  implications 
for  testing  activities  within  the  schools,  particularly  those  testing  activities 
involving  limited  English  speakers  and  non-English  speakers.  First,  there  is 
the  question  of  initial  assessment  for  educational  placement.  Here  the 
objective  is  to  determine  as  accurately  as  possible  the  level  of  past  educa- 
tional achievement  of  the  student.  Tests  therefore  have  to  be  constructed  in 
the  language  which  the  students  brings  to  the  schools.  Second,  the  progress 
of  these  limited  English  speakers  in  the  schools  must  be  monitored,  and 
again  special  tests  must  be  developed. 

What  are  the  practices  in  test  administration  with  limited  English  speakers 
and  non-English  speakers  in  the  San  Francisco  public  schools?  In  the 
administration  of  tests  at  the  District  level,  no  adjustment  is  made  for  limited 
English  speakers.  Non-English  speakers  are  assigned  a  score  of  zero  and  a 
booklet  with  their  names  is  submitted  together  with  remaining  test  forms.  In 
the  state  level  testing  program,  students  are  given  the  test  if  the  teacher 
feels  that  the  student  can  answer  some  of  the  questions  without  guessing. 
Non-English  speakers  are  not  tested  at  all.  Their  names  are  submitted  and 
they  are  given  chance  scores.  Overall,  procedures  for  testing  of  limited 
English  speakers  and  non-English  speakers  are  less  than  satisfactory. 

There  is,  however,  at  least  one  unit  within  the  District  which  has  been 
designed  to  deal  with  many  of  the  special  problems  of  assessment,  at  least  for 
Spanish-speaking  students.*  The  Latino  Assessment  Center  was  established 
for  the  following  reasons: 


*Noteworthy  assessment  activities  are  also  to  be  found  in  the  Chinese  Education 
Center  and  the  Filipino  Education  Center. 
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TABLE  6 

Spoken  Language  Background  of  Students  Enrolled  in 

the  San  Francisco  Unified  Schools  and  in  the  State 

of  California  (Spring  1974  Census) 


Percent 

Speaking 

Language  Spoken 

District 

State 

English  Only 

65 

79 

Fluent  English  and  Other  Language 

19 

11 

Limited  English  and  Other  Language 

14 

7 

Non-English  Speaking 

2 

1 

Other  Language  Spoken 

Armenian 

0 

0 

Chinese 

11 

1 

French 

0 

0 

German 

0 

0 

Greek 

0 

0 

Italian 

0 

0 

Japanese 

1 

1 

Korean 

1 

0 

Portuguese 

0 

0 

Punjabi 

0 

0 

Russian 

0 

0 

Spanish 

11 

15 

Tagalog 

5 

1 

Other 

3 

1 

1.  There  were  few,  if  any,  professionals  capable  of  diagnostic,  remedial, 
and  prescriptive  work  with  these  children.  This  is  a  factor  which  may 
have  contributed  to  the  large  representation  of  Spanish-surnamed 
children  in  the  special  education  classes,  to  the  small  number  of  these 
children  in  the  gifted  classes,  and  to  their  high  dropout  rate  during  their 
high  school  years. 

2.  Although  there  are  many  possible  community  resources  that  could  have 
helped,  the  problems  were  in  the  area  of  communication  between  these 
resources  and  in  matching  of  resource  to  recipient. 
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The  Center  was  established  in  1973  to  provide  assessment  of  the  educational, 
social,  health,  welfare  and  psychological  needs  of  newly  arrived  school 
children  from  Mexico,  Latin  America,  Central  America,  South  America,  and 
other  Spanish  speaking  countries. 

District  personnel  often  have  the  language  background  to  develop  the  tests 
but  do  not  possess  skills  in  test  development.  If  the  tests  are  to  be 
accurate  measures  of  pupil  accomplishment,  their  development  should  be 
informed  by  testing  specialists.  Personnel  should  be  available  to  the  bilingual 
program,  to  the  Latino  Assessment  Center,  and  to  other  programs  for  such 
purposes.  The  most  practical  arrangement  for  making  the  recommended 
services  available  is  to  centrally  locate  the  testing  specialists  who  can  be 
available  to  any  individual,  office,  program,  or  division  requiring  assistance 
in  the  development  of  tests  or  other  assessment  instruments. 


The  Testing  of  Minority  Group  Children 

Minority  group  members  have  long  been  concerned  about  the  use  of  tests  in 
educational  placement  decisions.  Controversies  have  focused  on  the  use  of 
tests  of  intelligence  (IQ  tests)  in  decisions  about  placement  of  children  in 
special  classes,  particularly  for  the  educable  mentally  retarded. 

In  the  San  Francisco  schools  and  in  most  other  school  districts  throughout 
the  State  of  California,  minority  group  children  have  been  disproportionately 
represented  in  classes  for  the  educable  mentally  retarded.  Recent  data  from 
the  California  State  Department  of  Education  revealed,  for  example,  that 
while  blacks  comprised  8.9%  of  students  enrolled  in  California  public 
schools,  they  constituted  25%  of  those  enrolled  in  special  classes  for  the 
educable  mentally  retarded  (EMR).  Spanish-surname  students,  who  repre- 
sented 15.2%  of  California  public  school  enrollees,  constituted  23.0%  of 
those  in  special  classes  for  EMRs.  On  the  other  hand,  Anglos  constituted 
72.4%  of  the  total  school  population,  but  only  50%  of  those  in  classes  for 
the  educable  mentally  retarded. 

Many  believe  that  biased  IQ  tests  are  largely  responsible  for  the  dispro- 
portionate representation  of  minority  groups  in  special  classes.  Bias  is 
thought  to  enter  at  several  levels:  (1)  at  the  content  level,  where  decisions 
are  first  made  about  what  items  to  include  in  a  test;  (2)  at  the  level  of 
standardization,  where  decisions  are  made  about  the  population  for  whom 
the  test  is  appropriate ;  (3)  at  the  level  of  validation ,  where  efforts  are  made  to 
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determine  whether  or  not  tests  accomplish  what  they  have  been  designed  to 
accomplish;  and  (4)  at  the  level  of  test  administration,  where  psychologists 
often  are  thought  to  possess  inadequate  backgrounds  for  accurately  interpre- 
ting the  test  results.  In  making  these  claims,  it  is  argued  that  the  difficulties 
stem  from  the  fact  that  many  tests  of  ability  and  achievement  have  been 
conceptualized,  developed,  and  interpreted  from  Anglo,  middle  class  per- 
spectives, from  assumptions  that  there  is  a  commonality  of  experience 
shared  by  all  who  take  the  test,  and  from  assumptions  that  all  test-takers 
have  equal  facility  with  the  English  language,  understand  the  questions 
equally,  and  share  the  same  value  system. 

Indeed,  the  fact  of  disproportionate  representation  of  black  children  in 
special  classes  for  the  mentally  retarded  led  a  group  of  black  San  Francisco 
parents  and  the  Bay  Area  Association  of  Black  Psychologists  to  seek  relief, 
in  the  courts,  from  perceived  discriminatory  testing  and  placement  practices 
(Larry  P.  et  all.,  Plaintiffs,  v.  Wilson  Riles  et  al.,  Defendants,  No.  C-71 
2270,  United  States  District  Court,  Northern  District  California).  The 
preliminary  injunction,  the  appeal,  and  the  final  order  upheld  the  plaintiffs 
claim,  and  lead  to  the  State  Board  of  Education's  Resolution  of  January  9, 
1975,  disapproving  certain  IQ  tests  previously  required  by  law,  not  only  for 
black  pupils  but  for  other  pupils  as  well. 

With  respect  to  fair  assessment,  some  guidelines  have  been  developed  at  the 
state  level,  and  a  number  of  alternative  procedures  are  being  explored  by 
various  specialists  in  the  State  Department  of  Education,  their  contractors, 
the  California  Association  of  School  Psychologists  and  Psychometrists,  and 
others.  However,  the  development  of  adequate  safeguards  and  procedures 
is  likely  to  take  some  time  and,  in  any  case,  the  procedures  will  need  to  be 
implemented  by  persons  capable  of  putting  the  findings  in  an  appropriate 
context.  Indeed,  there  is  general  agreement  that  even  when  IQ  tests  are  used 
in  a  placement  decision,  they  must  be  used  in  conjunction  with  a  variety  of 
facts,  including  other  test  results,  teacher  opinions,  child  observations,  and 
information  on  the  child's  background  and  culture. 

Decisions  about  placement  of  children  require  psychologists  who  are  capable 
of  synthesizing  such  information  in  the  light  of  cultural  and  other  factors. 
While  it  cannot  be  assumed  that  psychologists  of  the  same  racial  group  as  the 
student  have,  by  virtue  of  this  fact  alone,  the  background  to  properly  make 
educational  assessments  of  minority  children,  it  does  seem  reasonable  that 
they  probably  have  an  advantage.  Indeed,  in  the  Larry  P.  v.  Riles  case,  the 
reassessment  of  the  black  plaintiffs  by  black  psychologists  was  a  factor  in 
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highlighting  the  inaccurate  categorization  of  many  of  the  children  as  educable 
mentally  retarded. 

Three  recommendations  emerge  from  this  analysis: 

1 .  The  number  of  minority  psychologists  employed  in  the  Pupil  Services 
Division  should  be  increased  to  more  nearly  match  the  proportion  of 
minority  group  children  seen  for  psychological  assessment. 

Presently,  there  are  32  psychologists*  in  the  Pupil  Services  Division.  Of  this 
total  number,  two  are  black,  three  Oriental,  two  Chicano,  and  twenty-five 
white.  The  majority  of  children  seen  for  psychological  assessment  for  special 
class  placement  are  from  minority  groups.  If  analyses  concerning  the  value  of 
effecting  some  match  between  the  race  of  the  examiner  and  of  the  examinee 
has  any  merit,  steps  will  need  to  be  taken  to  redress  the  psychologist-client 
racial  imbalance. 

Since  the  probability  of  employing  additional  psychologists  appears  small  at 
the  present  time,  consideration  might  be  given  to  the  development  of  a  Black 
Assessment  Center.  Such  a  Center  is  needed  particularly  in  light  of  the  small 
number  of  black  psychologists  employed  in  the  District  (2),  the  large  per- 
centage of  black  children  in  the  District  (see  Table  7),  and  the  difficult 
problems  of  accurately  assessing  black  children.  The  difficulty  is  greatest  in 
the  so  called  "grey  cases".  These  are  individuals  who  are  neither  obviously 
retarded  nor  obviously  gifted,  and  for  whom  the  psychologist's  judgment  and 
knowledge  of  the  language  and/or  cultural  background  become  crucially 
important  in  interpreting  the  test  results.  These  "grey  area"  individuals  are 
those  who  are  the  contested  cases  and  who  often  have  been  erroneously 
placed  in  classes  for  the  retarded  and  disturbed. 

It  is  not  envisioned  that  all  black  children  will  be  tested  in  the  Center. 
Rather,  the  Center  is  viewed  as  a  base  for  the  inservice  training  of  non- 
minority  psychologists  who  need  to  learn  to  improve  their  skills  in  the 
psychoeducational  assessment  of  black  children.  It  would  be  expected  that 
most  of  the  District's  psychologists  would  rotate  through  the  Center  and,  as 
a  consequence  of  their  short-term  experience  in  the  Center,  be  better  pre- 
pared to  work  with  black  children.  If  such  a  Center  were  to  be  established,  it 
is  expected  that  it  would  be  staffed  by  already  employed  minority  and  non- 
minority  psychologists. 


This  number  includes  five  part-time  psychologists,  all  white. 
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TABLE  7 


Ethnic  Group  Membership  of  Students  Enrolled  in  Schools 

in  the  San  Francisco  Unified  School  District  and  in 

Other  Schools  in  the  State  of  California  (1974  Census)1 


Percent 


Ethnic  Group  Membership 


District 

State 

0 

0 

32 

9 

16 

3 

15 

20 

10 

2 

25 

62 

American  Indian 

Black 

Oriental 

Spanish  Surnamed 

Other  Non-White 

Other  White 


1  The  racial  distributions  in  the  table  probably  were  developed  to  conform  to  state 
categories.  A  more  recent  and  precise  categorization  of  San  Francisco  pupils  by 
race/ethnic  classification  is  the  following:  Black  29.2,  Other  White  24.5,  Chinese 
17.1,  Spanish  Speaking  13.3,  Filipino  8.5,  Other  Non-White  4.1,  Japanese  1.6, 
Korean  0.7,  American  Indian  0.3. 


2.  A  Supervisor  of  Psychological  Services  should  be  reappointed. 

The  absence  of  a  supervisor  is  a  grave  shortcoming,  particularly  in  the  light  of 
the  problems  and  legal  issues  surrounding  the  testing  of  minority  group 
children  in  the  San  Francisco  schools.  A  need  exists  for  a  person  to  take  a 
leadership  role  in  the  exploration  of  alternative  assessment  procedures.  Such 
a  person  should  have  intimate  familiarity  with  the  problems  and  issues 
surrounding  the  testing  of  minority  children,  be  knowledgeable  about  the 
impact  of  cultural  factors  as  they  impinge  on  learning  and  on  test  perfor- 
mance, and  have  some  background  in  the  development  of  tests  and  other 
assessment  instruments.  Ideally,  he/she  should  be  trained  at  the  doctoral 
level. 

The  supervisor  would  be  housed  within  the  Pupil  Services  Division  and 
would  be  expected  to  give  leadership  in  monitoring  and  developing 
procedures  for  the  assessment,  evaluation,  and  prescription  of  all  pupils 
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referred  for  psychological  services.  This  is  not  a  new  position,  but  one  which 
has  been  unfilled  since  September  1975.  It  is  possible  that  the  position  can 
be  filled  by  a  psychologist  presently  employed  in  the  District. 

3.  The  San  Francisco  schools  should  constitute  an  Advisory  Board  of  lay 
citizens,  professionals,  and  School  District  personnel  to  provide  input  to  the 
Division  of  Pupil  Services  on  issues  and  problems  of  psychological  and 
educational  assessment  and  on  special  education  placement. 

The  board  should  be  constituted  to  be  representative  of  the  various  ethnic 
groups  present  in  the  District  and  should  have  as  its  major  charge  attention 
to  problems  in  assessing  children  from  minority  groups,  and  monitoring  their 
placement.  In  its  purely  advisory  role  and  from  its  diverse  perspectives,  the 
board  would  be  expected  to  provide  suggestions  for  and  reactions  to  various 
assessment  practices  and  placement  procedures,  and  as  an  early  assignment, 
should  be  consulted  in  the  selection  of  the  Supervisor  of  Psychological  Ser- 
vices. The  board  should  report  directly  to  the  School  Superintendent  who 
will  make  available  to  the  public  the  board's  annual  report. 

Minority  parents  and  professionals  are  deeply  concerned  about  issues  of  the 
psychological  assessment  of  minority  group  children  and  their  subsequent 
placement  in  special  classes,  particularly  for  the  mentally  handicapped. 
Indeed  it  was  the  concern  of  such  parents  and  professionals  which  led  to  the 
Larry  P.  v.  Riles  suit.  The  schools  need  to  convince  its  citizens  that  it  has 
taken  the  issues  raised  by  the  lawsuit  seriously  and  that  it  is  responding  to  the 
issues  raised  in  it.  Constitution  of  aboard  as  recommend  would  acknowledge 

the  valuable  assistance  which  interested  and  informed  citizens  can  play  in 
ensuring  equality  of  educational  opportunity,  and  also  communicate  to  citi- 
zens the  school  administration's  willingness  to  work  cooperatively  with  them 
in  solving  problems  which  have  been  identified  as  critical  in  the  education 
of  children.  In  constituting  a  board  of  wide  representativeness,  participants 
should  be  drawn  from  the  following  groups,  and  organizations,  among 
others:  Bay  Area  Bilingual  Association,  Education  Center  for  Chinese, 
Japanese  American  Citizens  League,  Westside  Community  Mental  Heath 
Center,  Bay  Area  Association  of  Black  Psychologists,  Bay  Area  Association 
of  Black  Social  Workers,  the  California  School  of  Professional  Psychology, 
the  Latina/Chicana  Psychologists,  Latin  American  Teachers  Association 
(SF),  and  the  Mission  Community  Mental  Health  Center. 
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COST  OF  IMPLEMENTING 
THE  RECOMMENDATIONS 

It  is  possible  that  most  of  the  recommendations  presented  herein  can  be 
implemented  at  little  or  no  additional  cost  to  the  District. 

1.  The  recommendations  to  centralize  testing  activities,  to  constitute  an 
advisory  board  to  the  Division  of  Pupil  Services  Division,  to  reactivate 
the  teacher-administrator  committee  on  the  standardized  testing  pro- 
gram and  to  structure  District  organizations  so  that  there  is  an  interface 
among  all  who  have  need  for  test  results  can  be  accomplished  at  little  or 
no  extra  cost.  Released  time  for  teachers  participating  as  members  of  the 
committee  on  the  standardized  testing  program  is  the  only  anticipated 
cost. 

2.  The  recommendation  to  provide  a  supervisor  of  psychological  services 
similarly  can  be  implemented  at  minimal  cost,  assuming,  of  course,  that 
the  supervisor  is  chosen  from  the  ranks  of  existing  psychologists.  Given 
budget  problems,  this  formerly  full-time  position  might  be  part-time. 
Implementation  would  therefore  require  only  that  the  caseload  of  one  of 
the  psychologists  be  reduced  to  accommodate  his/her  administrative 
assignment. 

3.  The  number  of  minority  psychologists  needs  to  be  increased.  However, 
if  no  new  staff  are  to  be  added  in  the  District,  at  least  during  the  next  few 
years,  the  recommendation  to  form  an  assessment  center  for  black  chil- 
dren may  be  the  most  workable  arrangement  for  ensuring  accurate 
appraisal  of  children  who  are  candidates  for  special  programs.  It  has 
been  reported  that  there  are  a  number  of  certified  psychologists  in  the 
District  who  hold  non-pupil  services  positions.  The  possibility  of  using 
these  individuals  as  psychologists  should  be  explored. 

4.  The  recommendation  to  expand  testing  activities  to  include  assessment 
of  school  attitudes  and  related  noncognitive  attributes,  to  develop  tests 
which  provide  information  about  achievement  in  absolute  rather  than 
relative  terms,  and  to  expand  the  staff  of  the  Division  of  Research  to  in- 
clude specialists  in  the  construction  of  educational  and  psychological 
tests  all  require  additional  funds.  While  there  appear  to  be  several  areas 
in  which  monies  are  spent  for  tests  which  serve  little  functional  purpose 
(at  least  as  related  to  the  instructional  program),  the  monies  presently 
cannot  be  touched.  Consequently,  if  the  recommendations  are  to  be 
implemented,  additional  funds  will  be  necessary. 
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APPENDIX 


RELATIONSHIP  OF  RECOMMENDATIONS  TO 
DISTRICT  REORGANIZATION 

The  District  has  recently  reorganized  its  centralized  administration  by 
creating  four  "mini  districts",  or  Quads.  This  new  administrative  structure 
is  in  its  formative  stages  and  no  doubt  will  be  elaborated  and  refined  in  the 
future.  Nevertheless,  the  relationship  of  recommendations  proffered  in  this 
report  need  to  be  considered  against  the  background  of  the  Quad  structure. 

Since  some  centralized  functions  will  necessarily  remain,  it  is  suggested 
that  the  Testing  Council  (Recommendation  #1)  be  established  at  the  Central 
Office.  Its  membership  would  include  the  various  Associate  Superintendents 
who  have  responsibility  for  the  Quads,  the  Director  of  Research,  the 
directors  of  various  state  and  federal  programs,  and  such  other  central 
office  administrative  personnel  (at  the  director  or  assistant  superintendent 
level)  having  assignments  related  to  instruction. 

The  recommendations  concerning  the  centralization  of  District  testing 
activities  and  expansion  of  the  staff  of  the  Division  of  Research  to  include 
specialists  in  the  construction  and  evaluation  of  educational  and  psychologi- 
cal tests  appear  related  to  a  centralized  structure  and  should  thus  be  retained 
at  the  Central  Office.  On  the  other  hand,  teacher-administrator  advisory 
committees  on  standardized  testing,  advisory  committees  on  testing,  and 
special  education  placement  might  be  established  at  the  "Quad"  level. 

A  Supervisor  of  Psychological  Services  might  be  a  centralized  officer,  but 
psychologists  might  be  assigned  to  Quads.  Thus  minority  psychologists 
would  be  distributed  over  the  District.  Obviously,  many  details  remain  to  be 
worked  out  if  these  recommendations  are  to  be  integrated  into  the 
administrative  reorganization;  but  insofar  as  can  be  determined,  none  of  the 
recommended  changes  seem  incompatible  with  the  reorganization  plan. 


